Detection of Aberrant Item Score Patterns : A Review
نویسندگان
چکیده
Methods for detecting item score patterns that are unlikely (aberrant) given that a parametric item response theory (IRT) model gives an adequate description of the data or given the responses of the other persons in the group are discussed. The emphasis here is on the latter group of statistics. These statistics can be applied when a nonparametric model is used to fit the data or when the data are described in the absence of an IRT model. After discussion of the literature on person-fit methods, the use of person-fit statistics in empirical data analysis is briefly discussed. In some situations, the analysis of item score patterns might reveal more information about examinees than the analysis of test scores. Finding an aberrant pattern does not explain the reason for the aberrance. A full person-fit analysis requires additional research into the motives, strategies, and backgrounds of the examinees who deviate from the statistical norm set by the model or group. (Contains 47 references.) (Author/SLD) *********************************************************************** Reproductions supplied by EDRS are the best that can be made * IC from the original document. * ***********************************************************************
منابع مشابه
The Influence of the Presence of Deviant Item Score Patterns on the Power of a Person-Fit Statistic
In studies investigating the power of person-fit statistics it is often assumed that the item parameters that are used to calculate the statistics can be estimated in a sample without aberrant persons. However, in practical test applications calibration samples most likely will contain aberrant persons. In the present study, the influence of the type and the number of aberrant persons in the ca...
متن کاملAberrant Learning Achievement Detection Based on Person-fit Statistics in Personalized e-Learning Systems
A personalized e-learning service provides learning content to fit learners’ individual differences. Learning achievements are influenced by cognitive as well as non-cognitive factors such as mood, motivation, interest, and personal styles. This paper proposes the Learning Caution Indexes (LCI) to detect aberrant learning patterns. The philosophy behind the LCI is that if any non-cognitive fact...
متن کاملAdjusted Rasch person-fit statistics.
Two frequently used parametric statistics of person-fit with the dichotomous Rasch model (RM) are adjusted and compared to each other and to their original counterparts in terms of power to detect aberrant response patterns in short tests (10, 20, and 30 items). Specifically, the cube root transformation of the mean square for the unweighted person-fit statistic, t, and the standardized likelih...
متن کاملNonparametric and Group-Based Person-Fit Statistics: a Validity Study and an Empirical Example
In person-fit analysis, the object is to investigate whether an item score pattern is improbable given the item score patterns of the other persons in the group or given what is expected on the basis of a test model. In this study, several existing group-based statistics to detect such improbable score patterns were investigated, along with the cut scores that have been proposed in the literatu...
متن کاملDetection and validation of unscalable item score patterns using item response theory: an illustration with Harter's Self-Perception Profile for Children.
We illustrate the usefulness of person-fit methodology for personality assessment. For this purpose, we use person-fit methods from item response theory. First, we give a nontechnical introduction to existing person-fit statistics. Second, we analyze data from Harter's (1985) Self-Perception Profile for Children (Harter, 1985) in a sample of children ranging from 8 to 12 years of age (N = 611) ...
متن کامل